UTILITY 
PATENT APPLICATION 
TRANSMITTAL 



sfOn/y for new nonprovisional applications under 37 CFR 1.53(b)) 



Attorney Docket No. 



35.C13212 



First Named Inventor or Application Identifier 



KATSUHISA OGAWA 



Express Mail Label No. 




^ APPLICATION ELEMENTS 

i >§ee MPEP chapter 600 concerning utility patent application contents. 

rcr 



ADDRESS TO: 



Assistant Commissioner foaiF^Snl 
Box Patent Application 
Washington, DC 20231 



1. 



□ Fee Transmittal Form 
(Submit an original, and a duplicate for fee processing) 



5.n 



Microfiche Computer Program (Appendix) 



2. 1 X I Specification Total Pages | 25 

3. fx] Dramngs (35 use 113) Total Stieets |7o[ 
4. 1 X I Oath or Declaration Total Pages \ 3 



7. Nucleotide and/or Amino Acid Sequence Submission 
(if applicable, all necessary) 

Computer Readable Copy 

Paper Copy (identical to computer copy) 

Statement verifying identity of above copies 



a. 



□ 



□ 



Newly executed (original or copy) 

Unexecuted for information purposes 

Copy from a prior application (37 CFR 1 .63(d)) 
(for continuation/divisional Witt) Box 17 completed) 
[Note Box 5 below] 

i. rn DELETION OF INVENTOR(S) 

Signed Statement attached deleting 
inventor(s) named in the prior application, 
see 37 CFR 1 63(d)(2) and 1.33(b). 



Incorporation By Reference (useable if Box 4c is checked) 
The entire disclosure of the prior application, from which a copy of 
the oath or declaration is supplied under Box 4c, is considered as 
being part of the disclosure of the accompanying application and is 
hereby incorporated by reference therein. 



ACCOMPANYING APPLICATION PARTS 



10. 
11. 
12. 

13. 

14. 
15. 
16. 



□ 
□ 

□ 
□ 
□ 

□ 
□ 
□ 



Assignment Papers (cover sheet & document{s)) 

37 CFR 3 73(b) Statement I I „ 

(when there is an assignee) I 1 P^^®"" Attorney 

English Translation Document (if applicable) 



Information Disclosure 
Statement (iDS)/PTO-1449 

Preliminary Amendment 



□ Copies of IDS 
Citations 



Return Receipt Postcard (MPEP 503) 
(Should be specifically itemized) 

Small Entity j | Statement filed in prior application 



Statement(s) 



Status still proper and desired 



Certified Copy of Priority Document(s) 
(if foreign priority is claimed) 

Other: 



17. If a CONTINUING APPLICATION, check appropriate box and supply the requisite infonnation: 

Continuation 1 1 Divisional 1 1 Continuation-in-part (CIP) of prior application No. / 


18. CORRESPONDENCE ADDRESS 


i X i Customer Number or Bar Code Label 


05514 

(insert Customer No. or Attach barcode labei here) 


or 1 1 Correspondence address below 


NAME 






Address 






City 




State 




Zip Code 




Country 




Telephone 




Fax 





Page 1 of 2 



CLAIMS 


(1) FOR 


(2) NUMBER FILED 


(3) NUMBER EXTRA 


(4) RATE 


(5) CALCULATIONS 




TOTAL CLAIMS 

(37 CFR 1.16(C)) 


19-20 = 


0 


A $ lo.OU = 


$ -0- 




INDEPENDENT 
CLAIMS (37cfr 1 16(b)) 


2-3 = 


0 


X $ 78.00 = 


$-0- 




MULTIPLE DEPENDENT CLAIMS (if applicable) (37 CFR 1.16(d)) 


$260.00 = 


$ -0- 






BASIC FEE 

(37 CFR 1.16(a)) 


$ 760.00 




Total of above Calculations = 


$ 760.00 




Reduction by 50% for filing by small entity (Note 37 CFR 1.9. 1.27, 1.28). 






TOTAL = 


$ 760.00 



19. Small entity status 

a. □ A Small entity statement is enclosed 

. I I A small entity statement was filed in the prior nonprovisional application and such status is stiil 
I I proper and desired. 

c. I I Is no longer claimed, 
^f l 20. I X I A check in the amount of $ 760.00 to cover the filing fee is enclosed. 

I 21. I I A check in the amount of $ to cover the recordal fee is enclosed. 

1 22. The Commissioner is hereby authorized to credit overpayments or charge the following fees to Deposit 
Account No. 06-1205: 

3- I X I Fees required under 37 CFR 1.16. 
^- I I Fees required under 37 CFR 1.17. 
c. I I Fees required under 37 CFR 1.18. 



SIGNATURE OF APPLICANT, ATTORNEY, OR AGENT REQUIRED 


NAME 


Leonard P. Diana (29,296) 


SIGNATURE 




DATE 


December 11, 1998 



A;13212UPA/irl 



Page 2 of 2 



- 1 



CFO 13212 US 



Image Pickup Element 

BACKGROUND OF THE INVENTION 
Field of the Invention 
5 The present invention relates to an image pickup 

element for outputting an arbitrary image region and an 
image pickup device for interpolating an arbitrary 
image region* 
Related Background Art 

10 In an image pickup device, to obtain a color image 

from a single image pickup element, light is incident 
on the image pickup element through color filter 
arrays. Color filter arrays are roughly classified 
into a primary color filter array and a complementary 

15 color filter array. In a primary color filter array, 
three filters, i.e., an R filter for transmitting only 
red light within the visible light range, a G filter 
for transmitting only green light within the visible 
light range, and a B filter for transmitting only blue 

20 light within the visible light range are arrayed in, 

e.g., a matrix. In a complementary color filter array, 
a cyan (to be referred to as "Cy" hereinafter) filter 
for shielding only red light within the visible light 
range, a magenta (to be referred to as "Mg" 

25 hereinafter) filter for shielding only green light 
within the visible light range, and a yellow (to be 
referred to as "Ye" hereinafter) filter for shielding 
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only blue light within the visible light range are 
arrayed in, e.g., a matrix. There are various color 
filter array patterns. Fig. 1 shows an example of the 
primary color filter array. This is called a Bayer 
5 matrix. 

The Bayer matrix will be described. Of the basic 
units of the array pattern of 2 x 2 color filters, only 
the upper left pixel can directly output a red signal 
from a photoelectric conversion element as a detection 
10 unit of an image pickup element. Only the upper right 
\Z and lower left pixels can output a green signal, and 

only the lower right pixel can output a blue signal. 
m To obtain the respective color signals from these 

pixels, interpolation processing is required. In 
15 interpolation, the value of a pixel to be interpolated 
i,p is obtained by signal processing or calculation based 

" on the values of the neighboring pixels. 

Figs. 2A to 2C are views for explaining an example 
of interpolation corresponding to the Bayer matrix 
20 shown in Fig. 1. Symbol O indicates an original pixel 
obtained from a photoelectric conversion element. 
Symbol A indicates an interpolated pixel obtained by 
interpolation. An arrow indicates the relationship 
between an interpolated pixel and its original pixel. 
25 Fig, 3 is a block diagram of a conventional 

single-plate color image pickup device. Referring to 
Fig. 3, the device comprises a CCD image pickup element 
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901, an A/D converter (ADC) 902, a memory 903, an 
int:erpolation circuit: 904, a signal processing circuil: 
905, and a D/A converter (DAC) 906. The memory 903 
requires a capacity corresponding to the number of bits 
5 of at least (two lines + two pixels) x ADC, The memory 
903 is constituted by, e.g., a FIFO having an output 
terminal at its middle point. 

In the CCD image pickup element 901, a 
photodetection signal obtained by each photoelectric 

10 conversion element is transferred in the vertical 
direction by a CCD and then transferred in the 
horizontal direction by a CCD. More specifically, when 
all photodetection signals of a certain line are 
transferred by the vertical CCD to reach the horizontal 

15 CCD, all the photodetection signals are sequentially 
transferred in the horizontal direction by the 
hori zonal CCD and output from an output terminal. This 
operation is sequentially performed for all lines. 
Therefore, photodetection signals (original pixels) are 

20 output from the CCD image pickup element 901 in the 
order of scanning lines, as shown on the CCD image 
pickup element 901 in Fig. 3. 

Each original pixel output from the CCD image 
pickup element 901 is A/D-converted by the ADC 902 and 

25 stored in the memory 903. A plurality of original 

pixels on each of the first, second, and third lines 
output from the memory 903 are input to the 



interpolation circuit 904 • The interpolation circuit 
904 interpolates as shown in Figs, 2A to 2C on the 
basis of these original pixels and outputs RGB signals 
interpolated by the interpolated pixels. The signal 
processing circuit 905 processes the RGB signals by 
color gain adjustment or edge enhancement. The DAC 906 
D/A-converts the processed RGB signals to output analog 
RGB signals. 

In the above-described prior art, interpolated 
pixels must be obtained on the basis of original pixels 
output from the CCD image pickup element 901 in the 
order of scanning lines. For this purpose, the ADC 
902, memory 903, and DAC 906 are required in addition 
to the interpolation circuit 904 and signal processing 
circuit 905, resulting in an increase in circuit scale. 

SUMMARY OF THE INVENTION 

It is an object of the present invention to 
provide an image pickup element capable ot outputting a 
signal from a pixel in an arbitrary basic block. 

It is an another object of the present invention 
to provide an image pickup element capable of 
outputting a signal from a pixel in an arbitrary basic 
block which is appropriate to calculation of 
interpolated pixel . 

It is an another object of the present invention 
to provide an image pickup device capable of reducing 



I 
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circuit scale. 

It is another object of the present invention to 
provide an image pickup device capable of obtaining an 
interpolated pixel without any A/D converter, memory 
5 for a plurality of lines, and D/A converter. 

In order to achieve the above object, according to 
an aspect of the present invention, there is provided 
an image pickup element comprising a plurality of 
photodetectors each having a color filter array, 
10 vertical direction selection means for selecting in a 
vertical direction an arbitrary basic block having at 
least two of the plurality of photodetectors, 
horizontal direction selection means for selecting the 
arbitrary basic block in a horizontal direction, and 
15 output means for parallelly outputting outputs from the 
photodetectors in the arbitrary basic block selected by 
the vertical direction selection means and the 
horizontal direction selection means, 

According to another aspect of the present 
20 invention, there is provided an image pickup device 
comprising: 

(A) an image pickup element including; 

(a) a plurality of photodetectors each having 
a color filter array; 
25 (b) vertical direction selection means for 

selecting in a vertical direction an arbitrary 
basic block having at least two of the plurality 
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of photodetectors ; 

(c) horizontal direction selection means for 
selecting the arbitrary basic block in a 
horizontal direction; and 
5 (d) output means for parallelly outputting 

outputs from the photodetectors in the arbitrary 
basic block selected by the vertical direction 
selection means and the horizontal direction 
selection means; 

0 10 (B) block storage means for storing a plurality of 

outputs from the image pickup elements in units of 
III basic blocks; and 

Ijfi (C) interpolation means for calculating an 

interpolated pixel on the basis of an output from the 
15 block storage means. 
% By the image pickup element having the above 

^ arrangement, processing on the output side is 

facilitated. 

In addition, by the above image pickup device, the 
20 circuit scale can be reduced. 

Other objects, features, and advantages of the 
present invention will be apparent from the following 
specification and accompanying drawings. 



25 BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a view showing the basic pattern of a 
color filter array in a Bayer matrix; 
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Figs. 2A, 2B and 2C are views for explaining an 
example of in-berpolation of RGB signals corresponding 
to the Bayer matrix; 

Fig, 3 is a block diagram showing the arrangement 
5 of a conventional single-plate color image pickup 
device; 

Fig. 4 is a block diagram showing the arrangement 
of a single-plate color image pickup device according 
to the present invention; 
10 Fig. 5 is a first view for explaining 

interpolation processing according to the first 
embodiment of the present invention; 

Fig. 6 is a second view for explaining 
interpolation processing according to the first 
15 embodiment of the present invention; 

Fig. 7 is a view showing the basic pattern of a 
complementary color filter array; 

Fig. 8 is a first view for explaining 
interpolation processing according to the second 
20 embodiment of the present invention; 

Fig. 9 is a second view for explaining 
interpolation processing according to the second 
embodiment of the present invention; 

Fig. 10 is a third view for explaining 
25 interpolation processing according to the second 
embodiment of the present invention; 

Fig. 11 is a block diagram showing the arrangement 



of an image pickup element according to the third 
embodiment of the present invention; and 

Fig. 12 is a block diagram showing the arrangement 
of an image pickup element according to the fourth 
embodiment of the present invention. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

In embodiments to be described below, an image 
pickup element such as so-called CMOS image pickup 
element capable of reading a pixel at an arbitrary 
portion at random is used. 

Fig. 4 is a block diagram showing the arrangement 
of an image pickup device according to the first 
embodiment. Referring to Fig. 4, the image pickup 
device comprises an image pickup element 101, a block 
memory 102, an interpolation circuit 103, and a signal 
processing circuit 104. 

Original pixels are read from the image pickup 
element 101 in units of 2 x 2 basic (minimum) blocks of 
a Bayer matrix. The block memory 102 stores read 
original pixels of a plurality of basic blocks. In 
this embodiment, the block memory 102 stores three 
basic blocks in the horizontal direction and three 
basic blocks in the vertical direction, i.e., a total 
of nine basic blocks. The interpolation circuit 103 
interpolates as shown in Figs. 2A to 2C on the basis of 
the original pixels stored in the block memory 102 and 
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outputs interpolated RGB signals. The signal 
processing circuit 104 processes the interpolated RGB 
signals by color gain adjustment, low- frequency 
filtering, or edge enhancement and outputs the 
5 processed RGB signals. The signals obtained from the 
image pickup element 101 and output from the signal 
processing circuit 104 are analog signals. 

The block memory 102, interpolation circuit 103, 
and signal processing circuit 104 are formed on one 
© 10 chip together with the image pickup element 101. For 

example, when the image pickup element 101 is a CMOS 
Ijfl image pickup element, the image pickup element 101, 

p block memory 102, interpolation circuit 103, and signal 

r,, processing circuit 104 are formed on one chip by the 

15 same CMOS process. 
'J Fig. 5 is a view showing the array of original 

to pixels stored in the block memory 102. Referring to 

Fig. 5, symbols A, B, C, D, E, F, G, H, I, J, K, L, M, 
N, P, and Q denote basic blocks. The block memory 102 
20 simultaneously stores 3x3 basic blocks, as indicated 
by reference numeral 20 in Fig . 5 . 

Fig. 6 is a view for explaining interpolation 
processing by the interpolation circuit 103. The 
interpolation circuit 103 generates interpolated pixels 
25 pointed by arrowheads in Fig. 6 on the basis of the 

original pixels stored in the block memory 102, which 
are indicated by reference numeral 20 in Fig. 5, in 
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accordance with the following equations exemplifying 
the basic block F: 

Rf2 = (Rfi + Rgi)/2 

Rf4 = (RfI + Rki)/2 

Gpi = (G^2 + C3^2)/2 
= (Gf3 + G^3)/2 
Bpi = (B^4 + B,J/2 
Bp2 = {B34 + B,,)/2 
Br3 = (Be4 + B^4)/2 

When interpolation of the basic block F is 
complete^ the basic blocks D, H, and L are read from 
the image pickup element 101 and written in the block 
memory 102. The basic blocks A, E, and I are erased 
from the block memory 102. The interpolation circuit 
103 generates the interpolated pixels of the basic 
block G on the basis of the original pixels of the 
basic blocks B, C, D, F, G, H, 3^ and L in the same 
manner as described above. 

By repeating the block reading and interpolation, 
the interpolation circuit 103 outputs interpolated RGB 
signals in the order of, e.g-^r the basic blocks F, G, 
H, . . . , J, K, . . . , P, Q, . . . . However, the basic 
block output order is not limited to this. For 
example, when block processing such as calculation of 
the discrete cosine transforms (DCTs) of 8x8 pixels 
is to be done on the output side of the signal 



processing circuit, the signals can be read in the 
order of the basic blocks F, G, J, K, . . . . to 
continuously output 8x8 pixel data. The basic block 
size may be equal to the block processing size* 

An image pickup device according to the second 
embodiment has the same arrangement as that of the 
first embodiment shown in Fig, 4. In the second 
embodiment, a complementary color filter array is used 
as a color filter array. The arrangement of the image 
pickup device of the second embodiment is the same as 
that of the first embodiment shown in Fig, 4, and a 
detailed description thereof will be omitted. 

Fig. 7 is a view showing the basic pattern of the 
complementary color filter array in this embodiment. 
Referring to Fig. 7, the basic pattern has a size of 4 
lines X 2 pixels. 

The basic block size in block reading of this 
embodiment is the same as in the first embodiment, 
i.e., 2 X 2 pixels. The basic pattern of the color 
filter array is different from the basic block in block 
reading. 

Fig. 8 is a view showing the array of original 
pixels stored in a block memory 102. Referring to 
Fig. 8, symbols A, B, C, D, E, F, H, I, J, K, L, 

N, P, and Q denote basic blocks. The block memory 102 
simultaneously stores 3x3 basic blocks, as indicated 
by reference numeral 40 or 50 in Fig. 8. 
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Figs. 9 and 10 are views for explaining 
interpolation processing by an interpolation circuit 
103, Fig, 9 shows interpolation processing for basic 
blocks at an upper portion 201 of the basic pattern 
5 shown in Fig. 7. Fig. 10 shows interpolation 

processing for basic blocks at a lower portion 202 of 
the basic pattern shown in Fig. 7. Referring to 
Fig. 8, the basic blocks A, B, C, D, I, J, K, and L 
correspond to the upper portion 201, and the basic 

10 blocks E, F, G, H, M, P, and Q correspond to the 
lower portion 202. 

For the basic blocks at the upper portion 201, the 
interpolation circuit 103 generates interpolated pixels 
pointed by arrowheads in Fig. 9 on the basis of the 

15 original pixels stored in the block memory 102, which 
are indicated by reference numeral 40 in Fig. 8, in 
accordance with the following equations exemplifying 
the basic block J: 



cyj2 = 


(cy,i 


+ 


cyKi)/2 


cy.3 = 


(Cy.i 


+ 


CyKi)/2 


cyj4 = 


(cy,i 


4- 


cypi)/2 


Ye,i = 




+ 


Yej2)/2 


Ye,3 = 


(Ye^2 


+ 


Ye„2)/2 


Ye,4 = 


(Ye,2 


+ 


Ye„2)/2 


Mg.a = 


(Mgi4 


+ 


Mgj4)/2 


Mg^i = 


(Mgp3 


+ 


Mg^3)/2 


Mg.2 = 


(Mgo3 


+ 


Mg^3)/2 
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G,4 = (G,3 + G«3)/2 
G.i = (G^4 + G,,)/2 
G.2 = (Gp4 + G,,)/2 

For the basic blocks at the lower portion 202, the 
interpolation circuit 103 generates interpolated pixels 
pointed by arrowheads in Fig. 10 on the basis of the 
original pixels stored in the block memory 102, which 
are indicated by reference numeral 50 in Fig. 8, in 
accordance with the following equations exemplifying 
the basic block F: 

Cy^2 = (Cypi + Cyci)/2 

Cy„ = (Cypi + Cyii)/2 

Cyp4 = (Cypi + CyKi)/2 

Ye^i = (Ye^z + Yep2)/2 

Yep3 = (Yep2 + Yei2)/2 

Yep4 = (Yep2 + Ye^2)/2 

Mgp4 = (Mgps + Mg<53)/2 

Mgpi = (Mg^4 + Mgp4)/2 

Mg^z = (MgB4 + Mg^,)/2 

Gf3 = (Ge4 + Gp4)/2 

Gpi = (Gb3 + Gp3)/2 

Gf2 = (G„ + G„)/2 

The interpolation circuit 103 switches the two 
interpolation modes in accordance with the type of 
basic blocks. The original pixels are read from an 
image pickup element 101 and written in the block 
memory in the same manner as in the first embodiment. 
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By repeating the block reading and interpolation, 
the interpolation circuit 103 outputs interpolated 
CyMgYe signals in the order of, e.g., the basic blocks 

F, G, H,..., J, K, L,..., N, P, Q, However, the 

basic block output order is not limited to this. For 
example, when the DCTs of 8 x 8 pixels are to be 
calculated on the output side of the signal processing 
circuit, the signals can be read in the order of the 
basic blocks F, G, J, K, . . . . to continuously output 8 x 
8 pixel data. 

The arrangement of the image pickup element 101 
will be described next. Fig. 11 is a block diagram 
showing the arrangement of an image pickup element 101 
in the third embodiment. 

Referring to Fig. 11, the image pickup element 
comprises photodetectors 301 such as photodiodes, a 
vertical direction (row direction) read-out block 
selection circuit 302, a horizontal direction (column 
direction) read-out block selection circuit 303, 
transfer switches 304, vertical direction block 
selection lines 305, horizontal direction block 
selection lines 306, and output lines 307. The output 
lines are connected to an output terminal. 

For the vertical direction block selection lines 
305 equal in number to the basic blocks in the vertical 
direction, the vertical direction read-out block 
selection circuit 302 activates only lines of selected 
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blocks. Similarly, for the horizontal direction block 
selection lines 306 equal in number to the basic blocks 
in the horizontal direction, the horizontal direction 
read-out block selection circuit 303 activates only 
5 lines of selected blocks. Each photodetector 301 

outputs a detection signal only when both the vertical 
direction block selection line 305 and horizontal 
direction block selection line 306 are activated. Each 
of the transfer switches 304 equal in number to the 

10 basic blocks in the horizontal direction receives the 
detection signal when any one of the basic blocks 301 
of a line to which the transfer switches 304 belong 
outputs a detection signal. The outputs from the 
transfer switches 304 are coupled and sent to the 

15 output terminal. Since one of the outputs is selected 
by the horizontal direction block selection lines 306, 
only the detection signal from the basic block selected 
by the vertical direction block selection line 305 and 
horizontal direction block selection line 306 is output 

20 from the output terminal. 

When the vertical direction read-out block 
selection circuit 302 and horizontal direction read-out 
block selection circuit 303 are simultaneously 
operated, the detection signal from an arbitrary basic 

25 block can be output from the output terminal. 

Fig. 12 is a block diagram showing the arrangement 
of an image pickup element 101 according to the fourth 
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embodiment . 

Referring to Fig. 12, the device comprises 
photodetectors 401 such as photodiodes, a vertical 
direction (row direction) read-out block selection 
circuit 302, a horizontal direction (column direction) 
read-out block selection circuit 303, a two-line memory 

402, vertical direction photodetector selection lines 

403, horizontal direction block selection lines 306, 
and output lines 307. The output lines are connected 
to an output terminal. The vertical direction read-out 
block selection circuit 302, horizontal direction 
read-out block selection circuit 303, vertical 
direction block selection lines 305, and horizontal 
direction block selection lines 306 are the same as 
those of the third embodiment. 

For the vertical direction photodetector selection 
lines 403 equal in number to the photodetectors in the 
vertical direction, the vertical direction read-out 
block selection circuit 302 activates only lines of 
selected blocks. Since the outputs from photodetectors 
on one line are output to the same line, the lines are 
sequentially activated. For the horizontal direction 
block selection lines 306 equal in number to the basic 
blocks in the horizontal direction, the horizontal 
direction read-out block selection circuit 303 
activates only lines of selected blocks. Each 
photodetector 401 outputs a detection signal only when 
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a corresponding vertical direction photodetector 
selection line 403 is activated. The two-line memory 
402 sequentially receives the outputs from basic blocks 
selected in the vertical direction. The two-line 
5 memory 402 outputs the signal of a basic block selected 
by a horizontal direction block selection line 306. 
Hence, only the detection signals from basic blocks 
selected by the vertical direction photodetector 
selection lines 403 selected by the vertical direction 

10 read-out block selection circuit 302, and the 

horizontal direction block selection lines 306, are 
output from the output terminal . 

When the vertical direction read-out block 
selection circuit 302 and horizontal direction read-out 

15 block selection circuit 303 are simultaneously 

operated, the detection signal from an arbitrary basic 
block can be output from the output terminal. 

As has been described above, according to the 
first to fourth embodiments, since photodetection 

20 signals are read from the image pickup elements in 
units of basic blocks, basic blocks necessary for 
interpolation processing are stored in the block 
memory, and interpolated pixels of the respective 
colors are obtained on the basis of the photodetection 

25 signals stored in the block memory, an interpolated 
signal of each color in an arbitrary region can be 
obtained at random. 
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In addition, since all signal processing 
operations can be performed as analog processing, the 
A/D and D/A converters can be omitted. Therefore, the 
circuit scale can be reduced. 

Furthermore, since the image pickup element, block 
memory, interpolation circuit, and signal processing 
circuit can be formed on one chip by the same process, 
a one-chip image pickup device can be realized. 

Many widely different embodiments of the present 
invention may be constructed without departing from the 
spirit and scope of the present invention. It should 
be understood that the present invention is not limited 
to the specific embodiments described in the 
specification, except as defined in the appended 
claims. 



- 19 - 



WHAT IS CLAIMED IS: 




An image pickup element comprising: 



/a plurality of photodetectors each having a color 
filter array; 

vertical direction selection means for selecting 
in a vertical direction an arbitrary basic block having 
at least two of said plurality of photodetectors; 

horizontal direction selection means for selecting 
the arbitrary basic block in a horizontal direction; 
and 

output means for parallelly outputting outputs 
from said photodetectors in the arbitrary basic block 
selected by said vertical direction selection means and 
said horizontal direction selection means, 

2, An element according to claim 1, wherein a 
region of the basic block equals a region of a basic 
pattern of repeated patterns of the color filter array • 

3, An element according to claim 1, wherein a 
region of the basic block equals a region obtained by 
equally dividing a basic pattern of repeated patterns 
of the color filter array. 



4. An element according to claim 1, wherein said 
output means comprises selection means for selecting 
the basic block in the horizontal direction to output 
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the outputs from said photodetectors in the basic 
block. 

5. An element according to claim 2, wherein said 
output means comprises selection means for selecting 
the basic block in the horizontal direction to output 
the outputs from said photodetectors in the basic 
block. 

6. An element according to claim 3, wherein said 
output means comprises selection means for selecting 
the basic block in the horizontal direction to output 
the outputs from said photodetectors in the basic 
block . 

7. An element according to claim 1, wherein 
said vertical direction selection means selects 

said photodetectors in the selected basic block in 
units of lines with a time delay, and 

said output means comprises storage means for 
storing the outputs from said photodetectors selected 
by said vertical direction selection means with a time 
delay and parallelly outputting signals from said 
photodetectors in the basic block. 

8. An element according to claim 2, wherein 
said vertical direction selection means selects 



said phot:ode1:ect:ors in the selected basic block in 
units of lines with a time delay, and 

said output means comprises storage means for 
storing the outputs from said photodetectors selected 
by said vertical direction selection means with a time 
delay and parallelly outputting signals from said 
photodetectors in the basic block. 

9 . An element according to claim 3 , wherein 
said vertical direction selection means selects 

said photodetectors in the selected basic block in 
units of lines with a time delay, and 

said output means comprises storage means for 
storing the outputs from said photodetectors selected 
by said vertical direction selection means with a time 
delay and parallelly outputting signals from said 
photodetectors in the basic block. 

10. An element according to claim 1, wherein the 
color filter array comprises a filter for transmitting 
only red light within a visible light range, a filter 
for transmitting only green light within the visible 
light range, and a filter for transmitting only blue 
light within the visible light range. 

11. An element according to claim 2, wherein the 
color filter array comprises a filter for transmitting 
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only red light within a visible light range, a filter 
for transmitting only green light within the visible 
light range, and a filter for transmitting only blue 
light within the visible light range. 

5 

12. An element according to claim 3, wherein the 
color filter array comprises a filter for transmitting 
only red light within a visible light range, a filter 
for transmitting only green light within the visible 
10 light range, and a filter for transmitting only blue 
light within the visible light range. 



13. An element according to claim 1, wherein the 
color filter array comprises a filter for shielding 
15 only red light within a visible light range, a filter 

for shielding only green light within the visible light 
range, a filter for shielding only blue light within 
the visible light range, and a filter for transmitting 
only green light within the visible light range. 

20 

14. An element according to claim 2, wherein the 
color filter array comprises a filter for shielding 
only red light within a visible light range, a filter 
for shielding only green light within the visible light 
25 range, a filter for shielding only blue light within 

the visible light range, and a filter for transmitting 
only green light within the visible light range. 
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15, An element according to claim 3, wherein the 
color filter array comprises a filter for shielding 
only red light within a visible light range, a filter 
for shielding only green light within the visible light 
range, a filter for shielding only blue light within 
the visible light range, and a filter for transmitting 
only green light within the visible light range. 



(a) a plurality of photodetectors each having 
a color filter array; 

(b) vertical direction selection means for 
selecting in a vertical direction an arbitrary 
basic block having at least two of said plurality 
of photodetectors ; 

(c) horizontal direction selection means for 
selecting the arbitrary basic block in a 
horizontal direction; and 

(d) output means for parallelly outputting 
outputs from said photodetectors in the arbitrary 
basic block selected by said vertical direction 
selection means and said horizontal direction 
selection means; 

(B) block storage means for storing a plurality of 
outputs from said image pickup elements in units of 
basic blocks; and 




) an image pickup element including; 



An image pickup device comprising: 
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(C) interpolation means for calculating an 
interpolated pixel on the basis of an output from said 
block storage means. 

17. A device according to claim 16, wherein said 
block storage means and said interpolation means are 
formed on one semiconductor chip together with said 
image pickup element, 

18. A device according to claim 16, further 
comprising signal processing means for performing at 
least one of color gain adjustment, low- frequency 
filtering, and edge enhancement. 

19. A device according to claim 18, wherein said 
block storage means, said interpolation means, and said 
signal processing means are formed on one semiconductor 
chip together with said image pickup element. 
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ABSTRACT OF THE DISCLOSURE 

To output a color image signal of an arbitrary 
basic block and facilitate processing on the output 
side, an image pickup element including a plurality of 
5 photodetectors each having a color filter array, a 

vertical direction selection circuit for selecting in 
the vertical direction an arbitrary basic block having 
at least one of the plurality of photodetectors, a 
horizontal direction selection circuit for selecting 
10 the arbitrary basic block in the horizontal direction, 
and an output circuit for parallelly outputting outputs 
from the photodetectors in the arbitrary basic block 
selected by the vertical direction selection circuit 
and horizontal direction selection circuit is provided. 
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